Unbiased Entropy Estimator for Binary Sequences
نویسندگان
چکیده
منابع مشابه
Permutation Entropy for Random Binary Sequences
In this paper, we generalize the permutation entropy (PE) measure to binary sequences, which is based on Shannon’s entropy, and theoretically analyze this measure for random binary sequences. We deduce the theoretical value of PE for random binary sequences, which can be used to measure the randomness of binary sequences. We also reveal the relationship between this PE measure with other random...
متن کاملA New Estimator of Entropy
In this paper we propose an estimator of the entropy of a continuous random variable. The estimator is obtained by modifying the estimator proposed by Vasicek (1976). Consistency of estimator is proved, and comparisons are made with Vasicek’s estimator (1976), van Es’s estimator (1992), Ebrahimi et al.’s estimator (1994) and Correa’s estimator (1995). The results indicate that the proposed esti...
متن کاملThe Minimum Variance Unbiased Estimator
This module motivates and introduces the minimum variance unbiased estimator (MVUE). This is the primary criterion in the classical (frequentist) approach to parameter estimation. We introduce the concepts of mean squared error (MSE), variance, bias, unbiased estimators, and the bias-variance decomposition of the MSE. The Minimum Variance Unbiased Estimator 1 In Search of a Useful Criterion In ...
متن کاملUnbiased Estimators for Entropy and Class Number
We introduce unbiased estimators for the Shannon entropy and the class number, in the situation that we are able to take sequences of independent samples of arbitrary length. Introduction. This paper supposes that we may pick a sequence of arbitrary length of independent samples w1, w2, . . . from an infinite population. Each sample belongs to one of M classes C1, C2, . . . , CM , and the proba...
متن کاملA global estimator unbiased by local changes.
The global activity is an important confound when analyzing PET data in that its inclusion in the statistical model can substantially reduce error variance and increase sensitivity. However, by defining global activity as the average over all voxels one introduces a bias that is collinear with experimental factors. This leads to an underestimation of true activations and the introduction of art...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Modeling and Analysis of Information Systems
سال: 2015
ISSN: 2313-5417,1818-1015
DOI: 10.18255/1818-1015-2013-1-107-115